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TITLE: Modeling objects, systems, and simulations by establishing relationships in 
an event-driven graph in a computer implemented graphics system 

Abstract Text (1) : 

A computer-implemented graphics system defines an object-oriented framework for 
describing three-dimensional (3D) graphical objects, systems, and simulations . A 3D 
graphical image, a system, and a simulation are implemented as a directed multi- 
graph that includes a plurality of components defined by nodes connected by edges. 
A directed multi-graph engine in a graphics computer program processes the directed 
multi-graphs, wherein each node in the graph performs some specific function and 
the edges define relationships between the nodes. There are no restrictions on node 
types, and thus nodes may represent graphic objects (a visual representation), 
rules (rule-base behavior), attributes (data that does not affect the fundamental 
definition of the object), properties (data that affects the fundamental definition 
of the object), behaviors (methods), finite state machines (a sequence of actions 
and states), and any other user-defined component. There are no restrictions on 
edge types, and thus edges may represent event filters, connectivity, data, 
constraints, and any other user-defined relationship. Events traverse the graph, 
wherein the edges determine if and how traversal of the nodes is performed and any 
node may perform some sequence of operations in response to this traversal and the 
state of the graph. 

Brief Summary Text (3) : 

The present invention relates generally to computer-implemented graphics systems, 
and in particular, to a method, apparatus, and article of manufacture for modeling 
objects, systems, and simulations by establishing relationships in an event-driven 
graph in a computer-implemented graphics system. 

Brief Summary Text (7) : 

Moreover, most 3D graphics systems provide very simple interfaces to end-users and 
application developers. For example, they may provide a set of drawing commands 
that can be used to create visual representations of modeled 3D objects and 
simulations, but they rarely allow end-users or application developers to exploit 
any correlation between modeled objects and object-oriented programming techniques. 
While some object-oriented techniques are available, they do not go far enough. 
Consequently, there is a need in the art for 3D graphics systems that provide an 
improved object-oriented programming environment accessible to end-users and 
application developers. 



Brief Summary Text (9) : 

To address the requirements described above, the present invention discloses a 
computer- implemented method, apparatus, and article of manufacture defining an 
object-oriented framework for describing three-dimensional (3D) graphical objects, 
systems, and simulations . An object, system, or simulation is implemented as a 
directed multi-graph that includes one or more nodes connected by zero or more 
edges. A directed multi-graph engine in a graphics computer program processes the 
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directed multi-graphs, wherein each node in the graph provides specific 
functionality as it defines a component of an object, system, or simulation, and 
the edges define the relationships between the nodes. There are no restrictions on 
node types, and thus nodes may represent graphic objects (a visual representation), 
rules (rule-base behavior), attributes (data that does not affect the fundamental 
definition of the object), properties (data that affects the fundamental definition 
of the object), behaviors (methods), finite state machines (a sequence of actions 
and states), and user-defined node types. There are no restrictions on edge types, 
and thus edges may represent event filters, connectivity graphic and logical), 
data, constraints, and user-defined edge types. Events traverse the graph, wherein 
edges determine if and how traversal of the nodes is performed, and any node may 
perform some sequence of operations in response to this traversal and the state of 
the graph. 

Drawing Description Text (7) : 

FIGS. 5A and 5B are block diagrams that illustrate objects, systems, and 
simulations in a graph in the computer-implemented graphics program according to 
the preferred embodiment of the present invention; 

Detailed Description Text (4) : 

The present invention defines an object-oriented framework for describing 3D 
graphical * objects, systems, and simulations as directed multi-graphs, each of which 
includes one or more nodes connected by zero or more edges. A directed multi-graph 
engine processes the directed multi-graphs, wherein each node in the graph defines 
a component of an. object, system, or simulation, and the edges define relationships 
between the nodes. Nodes provide specific functionality and thus may represent 
graphic object components (a visual representation), rule components (rule-base 
behavior) , attribute components (data that does not affect the fundamental 
definition of the object), property components (data that affects the fundamental 
definition of the object), behavior components (methods), finite state machine 
components (a sequence of actions and states), and other user-defined components. 
Edges may represent event relationships, connectivity relationships (graphic and 
logical), data relationships, constraint relationships, and other user-defined 
relationships. Edges determine if and how events traverse the graph and the nodes 
may perform some sequence of operations in response to the traversal of the event 
and the state of the graph. 

Detailed Description Text (20) : 

Each node 304 in a graph 300 defines a component designed to perform some specific 
function of an object, system, or simulation . There are no restrictions on node 304 
types, and thus they may represent graphic objects (a visual representation), rules 
(rule-base behavior), attributes (data that does not affect the fundamental 
definition of the object) , properties (data that affects the fundamental definition 
of the object), behaviors (methods), finite state machines (a sequence of actions 
and states), and user-defined types. A node 304 may inherit properties from its 
parent node 304. 

Detailed Description Text (22) : 

Events traverse graphs 300 and any node 304 may change state and may perform some 
sequence of operations in response to the event and the current state of the node 
304, the object being defined, the system, or the simulation . Essentially, events 
may trace zero^or more edges 306 from node 304 to node 304.^ Events may be initiated 
externally (from an application/user) or internally (from any node 304) . 

Detailed Description Text (27): 

The present invention defines an object-oriented framework for describing three- 
dimensional (3D) graphical objects, systems, and simulations where nodes 304 define 
components designed to perform specific functions of objects, systems, and 
simulations . Specifically, the present invention implements a directed multi-graph 
300 framework to model objects, systems, and simulations in a graphics computer 
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program, where component nodes 304 are created, manipulated, and destroyed at 
runtime. Additionally node-to-node relationships in the graph 300 are also 
established at runtime as the graph 300 changes. One of the unique aspects of this 
model is that nodes 304 may represent graphic objects, behaviors, rules, 
properties, and attributes and other user-defined types. Nodes 304 can also define 
finite state machines, and the relationships between nodes 304 and their responses 
to events can be driven by state changes. 

Detailed Description Text (29) : 

Further, each of the directed multi-graphs 300 may define one or more event-driven 
finite state machines. Thus, when the DMG Engine 204 interprets and/or executes ' 
directed multi-graphs 300, it interprets and/or executes event-driven finite state 
machines. Moreover, the directed multi-graphs 300 are recursive in that any node 
304 can itself be a directed multi-graph 300 that may comprise a finite state 
machine. Finally, the relationships between nodes 304 in the directed multi-graphs 
300, as well as the responses of the nodes 304 to events, can be driven by state 
changes of the nodes 304, state changes of the finite state machines, state changes 
of the systems, and state changes of the simulations . 

Detailed Description Text (40) ; 

In still another example, the present invention could be used to expand the 
geometric constraints of the graphical program into logical behavior. It includes a 
variety of authoring techniques that assign behaviors to 3D objects such as "close 
to", "on top of", "behind", "inside", "looks good with", etc. The product will have 
the most appeal in context of simulations, quick layouts, realistic human 
interactions, etc., and will therefore stimulate applications in (Internet) 
retailing, virtual product experiences, computer games, etc. This product would use 
the DMG Engine 204 to find appropriate real world relationships between real world 
objects, taking into account all of the graphical and non-graphical constraints of 
these relationships. 

Detailed Description Text (48) : 

In summary, the present invention discloses a computer-implemented method, 
apparatus, and article of manufacture for defining an object-oriented framework for 
describing three-dimensional (3D) graphical objects, systems, and simulations . An 
object, system, or simulation is implemented as a directed multi-graph that 
includes one or more nodes connected by zero or more edges. A directed multi-graph 
engine in a graphics computer program processes the directed multi-graphs, wherein 
each node defines a component of an object, system, or simulation, and the edges 
define relationships between the nodes. There are no restrictions on node types, 
and thus nodes may represent graphic objects (a visual representation) , rules 
(rule-base behavior), attributes (data that does not affect the fundamental 
definition of the object) , properties (data that affects the fundamental definition 
of the object), behaviors (methods), and finite state machines (a sequence of 
actions and states) . There are no restrictions on edge types, and thus edges may 
represent events, connectivity (graphic and logical), data, and constraints. Events 
traverse the graph, wherein the edges determine if and how traversal of the nodes 
is performed and any node may perform some sequence of operations in response to 
this traversal and the state of the graph. 

CLAIMS : 

1. A computer- implemented graphics system, comprising: (a) a computer having an 
output device coupled thereto; (b) a database for storing dynamic -representations 
of a three-dimensional (3D) graphical image, system, or simulation as a graph, 
wherein the graph is comprised of at least one node and the nodes may be connected 
by zero or more edges; and (c) an Image Engine (IME) for processing the 3D 
graphical image, system, or simulation stored in the database and for delivering 
the processed 3D graphical image, system results, and simulation results to the 
output device, wherein the Image Engine includes a Directed Multi-Graph (DMG) 
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Engine for executing the graph stored in the database, each node in the graph 
defines a component designed to perform some specific function of the image, 
system, or simulation, the edges define relationships between the nodes, and events 
traverse the edges and the nodes of the graph, the edges determine whether and how 
the nodes are traversed, the nodes may perform at least one operation in response 
to the event traversal and a state of the graph, and the nodes are added to the 
graph and removed from the graph dynamically at runtime. 

2. The system of claim 1, wherein the nodes define the components of the image, 
system,* or simulation . 

13. The system of claim 1, wherein the relationships between nodes may be driven by 
changes in the state of the nodes, the state of the image, the state of the system, 
or the state of the simulation . 

14. A computer-implemented method of processing three-dimensional" (3D) graphical 
images, systems, and simulations, comprising: (a) storing a dynamic representation 
of a three-dimensional (3D) graphical image, system, or simulation as a graph in a 
database, wherein the graph is comprised of at least one node and the nodes may be 
connected by zero or more edges; and (b) processing the 3D graphical age, system, 
or simulation stored in the database in an Image Engine (IME) and delivering the 
processed 3D graphical image, system results, and simulation results to an output 
device, wherein the Image Engine includes a Directed Multi-Graph (DMG) Engine for 
executing the graphs stored in the database, each node in the graph defines a 
component designed to perform some specific function of the image, system, or 
simulation, the edges define relationships between the nodes, and events traverse 
the edges and the nodes of the graph, the edges determine whether and how the nodes 
are traversed, the nodes may perform at least one operation in response to the 
event traversal and a state of the graph, and the nodes are added to the graph and 
removed from the graph dynamically at runtime. 

15. The method of claim 14, wherein the nodes define the components of the image, 
system, or simulation . 

26. The method of claim 14, wherein the relationships between nodes may be driven 
by changes in the state of the nodes, the state of the image, the state of the 
system, or the state of the simulation . 

27. An article of manufacture embodying logic for performing a computer-implemented 
method of processing three-dimensional (3D) graphical images, systems, and 
simulations, the method comprising: (a) storing a dynamic representation of a 
three-dimensional (3D) graphical image, system, or simulation as a graph in a 
database, wherein the graph is comprised of at least one node and the nodes may be 
connected by zero or more edges; and (b) processing the 3D graphical image, system, 
or simulation stored in the database in an Image Engine (IME) and delivering the 
processed 3D graphical image, system results, or simulation results to an output 
device, wherein the Image Engine includes a Directed Multi-Graph (DMG) Engine for 
executing the graphs stored in the database, each node in the graph defines a 
component designed to perform some specific function of the image, system, or 
simulation, the edges define relationships between the nodes, and events traverse 
the edges and the nodes of the graph, the edges determine whether and how the nodes 
are traversed, the nodes may perform ^at least one operation in response to the 
event traversal and a state of the graph, and the nodes are added to the graph and 
removed from the graph dynamically at runtime. 

28. The method of claim 27, wherein the nodes define the components of he image, 
system, or simulation . 

39. The method of claim 27, wherein the relationships between nodes may be driven 
by changes in the state of the nodes, the state of the image, the state of the 
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system, or the state of the simulation . 
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ART-UNIT: 261 

PRIMARY-EXAMINER: Zimmerman; Mark 
ASSISTANT-EXAMINER: Santiago; Enrique L 
ATTY-AGENT-FIRM: Skabrat; Steven P. 

ABSTRACT : 

A method of scene simplification includes concurrently simplifying a plurality of 
objects in a scene represented by a hierarchical scene graph. The objects are 
represented as polygonal meshes and the hierarchical scene graph includes a 
plurality of nodes, each node storing a mesh. The scene is a three dimensional 
scene and the objects are representations of three dimensional objects. 
Concurrently simplifying the plurality of objects includes determining an initial 
least level of detail polygon reduction ratio (LPPR) for at least one mesh, 
generating levels of detail variables for at least one mesh using the LPRR, and 
generating a simplified version of at least one mesh by using the levels of detail 
variables . 

14 Claims, 7 Drawing figures 
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TITLE: Method of hierarchical static scene simplification 



Brief Summary Text ( 5 ) : - . .. - 

Comput er-qenerated '^^fej^wjf ^ imu 1 a t i on s are used in many application areas, such as 
flTght simulation, buiT3Tng walkthroughs, computational fluid dynamics, and video 
games, for example, with the purposes of training, evaluation, education, and 
entertainment. Since recent general purpose graphics workstations and personal 
computers (PCs) allow the interactive display of thousands of polygons making up 
representations of three dimensional (3D) objects, these simulations have become 
more common and accessible to a variety of users, such as scientists, educators, 
and game players. However, as graphics performance increases and its cost 
decreases, a new generation of users will demand even more complex and more 
realistic animations. Such animations will require real-time performance at 
approximately constant frame rates so that the user has the feeling of actual 
immersion in a virtual world. 

Brief Summary Text ( 6) : 

In response, content authors are creating more complicated simulations . A 
simulation may include many different scenes, each with many objects. An object is 
typically represented as a polygonal mesh. A complicated object may be represented 
by a mesh containing hundreds or thousands of polygons. When more polygons are 
present in the mesh, the quality of the image shown on the display is better (that 
is, it is more detailed), but the time required to display the object is higher. 
When less polygons are present in the mesh, the quality of the image is poorer, but 
the time required to display the object is lower. In some cases, a graphics 
subsystem cannot render a scene having many complicated objects in real-time. A 
graphics subsystem may attempt to simplify some or all of the objects so that the 
scene can be displayed more quickly. For example, if an object is initially 
represented by a mesh having 10, 000 polygons, it may be simplified by methods known 
in the art to a representation of the object having only 1,000 polygons. The object 
may be simplified further, for example, into a representation having only 100 
polygons. These different representations are called levels of detail (LCD). Such 
LCDs are commonly represented in a multi-resolution mesh (MRM) . Depending on the 
desired image quality and system bandwidth, different instances of a multi- 
resolution mesh representing an object may be used. 

Detailed Description Text (4) : 

An embodiment of the present invention operates within a 3D graphics application, 
which creates and manages a scene graph stored in a graphical database. A scene 
graph is a data structure used to store a scene. A scene graph is typically 
structured. as a tree, or more specif ically, . a directed acyclic graph (DAG). Nodes 
of^fehe tree represe'nt~^indi-vi''dual models of 3D objects present in a scene. The scene 
graph may comprise multiple complex, highly detailed polygonal surfaces or meshes 
arranged in a hierarchical manner. FIG. 1 is a diagram of a sample scene graph 
having three meshes according to an embodiment of the present invention. In this 
example, scene graph 10 comprises three polygonal meshes: M012, M114, and M216, 
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arranged in a hierarchy as shown. Although this example shows three meshes being 
part of the scene graph, one skilled in the art will understand that a scene graph 
may comprise any number of meshes in any number of levels of a hierarchy, and the 
present invention is not limited in scope in this respect. 

Detailed Description Text (60): 

According to an embodiment of the present invention, a triangular surface 
simplification method may be described as follows. It may be based on edge 
contraction, but it only supports manifold models . In terms of efficiency, the 
method may be used to simplify complex models quite rapidly. For example, it can 
create a 900 faces approximation of a 18,000 faces model in approximately 15 
seconds on a personal computer system having dual Pentium.RTM.il Xeon processors 
(commercially available from Intel Corporation) operating at 400 MHZ, with a IM 
internal cache, and 128 MB of memory. The method provides high quality 
approximations. The approximations produced by this technique maintain high 
fidelity to the original model . The sharp and primary features of the model, 
including the scalar attributes of texture coordinates/vertex color are preserved. 
In addition, the technique permits changes to the topology of discrete attributes, 
for example, the Material ID (texture) . 

Detailed Description Text (61): 

The technique may support terrain-like models (e.g., height fields), by adding an 
additional perpendicular plane running through a contracted edge, which in one 
embodiment may be weighted by a large penalty factor and subsequently added to the 
energy equation. The technique maintains a heap (a spatial partitioning data 
structure) which stores all valid edge contraction pairs indexed by their 
respective .0 slashed. E values. In addition, the technique uses a local 
optimization; each edge contraction action corresponds only to a local incremental 
modification of the current model. In fact, the technique generates a sequence of 
models M.sub.n, M.sub.n-1, . . . M.sub.i. Thus, a single pass may be used to 
produce a large number of approximate models or a multiresolution representation 
such as a progressive mesh (as discussed in Hugues Hoppe, "Progressive Meshes", 
SIGGRAPH'96 Proceedings, pages 99-108, August 1996.). 
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TITLE: Digital processing method of correlating 2D images to form a 3D 
reconstruction for e.g. graphics /animation 

Basic Abstract Text (2) : 

DETAILED DESCRIPTION - The overlapping 2D images from a camera is moved relative to 
an object between the different viewpoints (1,1*), the net movement of the camera 
between the viewpoints not being fully constrained. The respective orientations of 
the camera at different viewpoints relative to a reference frame which is fixed 
with respect to the object, differs by less than 10 degrees. The overlapping 2D 
images are projected from their nominal viewpoints such that the projections 
^intersect to form an initial 3D reconstruction in simulated 3D space. The line (ST) 
joining the camera positions is derived and a partia]r'3D reconstruction is derived 
by aligned virtual projectors ( PRl , PR2/PR2 ' ) located an arbitrary distance apart. 
The rotated and translated initial 3D reconstruction features, are generated from 
the intersecting projections of correlated features of the projected images to lie 
on the projections of those features from one of the 2D images, thereby forming a 
further reconstruction. The angle subtended by a pair of correlated features at the 
corresponding feature of the object is 90 degrees plus or minus 10 degrees, and the 
manipulation of the 3D reconstruction's are performed under the control of a 
computer pointing device operated by the 'user. Also the camera may be hand-held and 
carry a 3-axis vibratory gyroscope (G) with associated filtering (Kalman filter 
preferred) circuitry and integrating circuitry to generate and display on screen 3- 
axis orientation signals. INDEPENDENT CLAIMS are also included for the following: 

Basic Abstr ac:b_T.e,xjL ^(-8-) _ 

USE - For deriving a 3D representation f r om ^|^S^SlS§^li^D^pt&g'eS' for e.g. fields 
of design, graphics and animation . ~ 

Standard Title Terms (1) : 

DIGITAL PROCESS METHOD CORRELATE IMAGE FORM RECONSTRUCT GRAPHIC ANIMATED 
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LIS: Entry 1 of 2 



File: USPT 



Jul 20, 2004 



DOCUMENT-IDENTIFIER: US 6765574 Bl 

** See image for Certificate of Correction ** 

TITLE: Methods of hierarchical static scene simplification and polygon budgeting 
for 3D models 



Brief Summary Text ( 4 ) : 

Computer-generated visual simulations are used in many application areas, such as 
flight simulation, building walkthroughs, computational fluid dynamics, and video 
games, for example, with the purposes of training, evaluation, education, and 
entertainment. Since recent general purpose graphics workstations and personal 
computers (PCs) allow the interactive display of thousands of polygons making up 
representations of three dimensional ( 3D) objects, these simulations have become 
more common and accessible to a variety of users, such as scientists, educators, 
and game players. However, as graphics performance increases and its cost 
decreases, a new generation of users will demand even more complex and more 
realistic animations . Such animations will require real-time performance at 
approximately constant frame rates so that the user has the feeling of actual 
immersion in a virtual world. 



US Reference Patent Number (2) : 
6307558 
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L6: Entry 7 of 7 File: DWPI Nov 17, 1999 

DERWENT-ACC-NO: 2000-001700 
DERWENT-WEEK: 200003 

COPYRIGHT 2005 DERWENT INFORMATION LTD 

TITLE: Digital processing method of correlating 2D images to form a 3D 
reconstruction for e.g. graphics /animation 

INVENTOR: MEIR, I; WILSON, J 

PATENT-ASSIGNEE: TRICORDER TECHNOLOGY PLC (TRICN) 
PRIORITY- DATA: 1 998GB-0010553 (May 15, 1998) 

PATENT- FAMILY: 

PUB-NO PUB- DATE LANGUAGE PAGES MAIN- I PC 

□ GB 2337390 A November 17, 1999 040" H04N013/00 



APPLICATION-DATA: 

PUB-NO APPL-DATE APPL-NO DESCRIPTOR 

GB 2337390A June 8, 1998 1998GB-0012200 



INT-CL (IPC) : H04_ N 13/00 



RELATED-ACC-NO: 2000-039459 

ABSTRACTED-PUB-NO: GB 2337390A 
BASIC-ABSTRACT: 



NOVELTY - The method involves digitally processing 2D images to form a 3D 
reconstruction in which a common feature of the object (3) is located in a 
simulated 3D space in dependence upon both a mutual offset and a scaling variable. 
The reconstruction (30) in the simulated 3D space is displayed on screen and the 
scaling variable is entered by the user. 

DETAILED DESCRIPTION The overlapping 2D images from a camera is moved relative to 
an object between the different viewpoints (1,1'), the net movement of the camera 
between the viewpoints not being fully constrained. The respective orientations of 
the camera at different viewpoints relative to a reference frame which is fixed 
with respect to the object, differs by less than 10 degrees. The overlapping 2D 
images are projected from their nominal viewpoints such that the projections 
intersect to form an initial 3D reconstruction in simulated 3D space. The line (ST) 
joining the camera positions is derived and a partial 3D reconstruction is derived 
by aligned virtual projectors ( PRl , PR2/PR2 ' ) located an arbitrary distance apart. 
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The rotated and translated initial 3D reconstruction features, are generated from 
the intersecting projections of correlated features of the projected images to lie 
on the projections of those features from one of the 2D images, thereby forming a 
further reconstruction. The angle subtended by a pair of correlated features at the 
corresponding feature of the object is 90 degrees plus or minus 10 degrees, and the 
manipulation of the 3D reconstruction's are performed under the control of a 
computer pointing device operated by the user. Also the camera may be hand-held and 
carry a 3-axis vibratory gyroscope (G) with associated filtering (Kalman filter 
preferred) circuitry^ and integrating circuitry to generate and display on screen 3- 
axis orientation signals. INDEPENDENT CLAIMS are also included for the following: 

(1) an image processing apparatus 

(2) a method of determining the motion of a camera 

(3) an apparatus for determining the motion of a camera 

(4) a method of generating a 3D reconstruction of an object and 

(5) an apparatus for generating a 3D reconstruction of an object. 

USE - For deriving a 3D representation from two or more 2D images for e.g. fields 
of design, graphics and animation . 

ADVANTAGE - A scaled representation can be generated by any pair of virtual 
projectors on line ST, once the direction of the line ST is known. The procedure 
can be carried out either manually by the user with the aid of a suitable display 
of the images and ray lines on the screen or automatically with software. 

DESCRIPTION OF DRAWING (S) - The drawings show ray diagrams illustrating the 
relationship between the object, camera viewpoints, projector viewpoints and a 
partial 3D reconstruction; and a derivation of the direction of movement of the 
camera from the acquired images, respectively. 

Viewpoints 1,1' 

Object 3 

Reconstruction 30 

Aligned virtual projectors PR1,PR2,PR2' 
Line ST 

ABSTRACTED- PUB-NO: GB 2337390A 
EQUIVALENT-ABSTRACTS : 

CHOSEN-DRAWING: Dwg.2,3/3 

DERWENT-CLASS: TOl W02 

EPI-CODES: T01-J04B2; T01-J10C4; T01-J10C5; T01-J10C7; T01-S02; W02-F03B; 

Previous Doc Next Doc Go to Doc# 



http://westbrs: 9000/bin/gate.exe?f^doc&state=h4gp90. 1 5 .7&ESNAME=FR0&p_Message=. . . 8/25/05 



Record Display Form 



Page 1 of 3 



First Hit Fwd Refs 



Previous Doc 

n 



Next Doc Go to Doc# 



Generate Collection 



Print 



L6: Entry 4 of 7 



File: USPT 



May 1, 2002 



US-PAT-NO: 6384834 

DOCUMENT-IDENTIFIER: US 6384834 Bl 

TITLE: Three-dimensional simulator apparatus and image synthesis method using 
texture computation and texture information storage 

DATE-ISSUED: May 7, 2002 



INVENTOR-INFORMATION : 
NAME 

Watanabe; Hiroyuki 



CITY 
Yokohama 



STATE 



ZIP CODE 



COUNTRY 
JP 



AS S I GNEE - 1 N FORMAT I ON : 
NAME CITY 
Namco Ltd. Tokyo 



STATE 



ZIP CODE 



COUNTRY 
JP 



TYPE CODE 
03 



APPL-NO: 08/ 632463 [PALM] 
DATE FILED: April 22, 1996 



FOREIGN-APPL-PRIORITY-DATA: 
COUNTRY APPL-NO 
JP 6-219418 



APPL-DATE 
August 22, 1994 



PCT-DATA: 

APPL-NO DATE-FILED PUB-NO PUB-DATE 371-DATE 102(E) -DATE 

PCT/JP95/01628 August 16, 1995 WO96/06410 Feb 29, 1996 Apr 22, 1996 Apr 22, 1996 

INT-CL: [07] G06 T 11/40 

US-CL-ISSUED: 345/582; 345/581, 382/285 
US-CL-CURRENT: 345/582; 345/581, 382/285 

FIELD-OF-SEARCH: 395/129, 395/130, 345/429, 345/430, 345/425, 345/581, 345/582, 
463/31, 463/40, 434/62-70, 382/285 
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U.S. PATENT DOCUMENTS 
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345/340 


n 


5550960 
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Shriman et al. 
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5561745 


October 1996 


Jackson et al. 
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5561746 


October 1996 


Murata et al . 
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5577960 


November 1996 


Sasaki 
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5615322 


March 1997 


Murata et al. 
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5630043 


May 1997 


Uhlin 


345/474 
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5696892 


December 1997 


Redmann et al . 


345/425 



FOREIGN PATENT DOCUMENTS 



FOREIGN- PAT-NO 

1-131976 

1-131976 

6-103385 

06-223199 



PUBN-DATE 
May 1989 
May 1989 
April 1994 
December 1994 



COUNTRY 

JP 

JP 

JP 

JP 



US-CL 



OTHER PUBLICATIONS 



"Visualization for Climate Modeling": Nelson Max et al; IEEE Computer Graphics & 
Application, 0272-17-16/93/0700-/0034 . * 

Korein et al., "Temporal Anti-Aliasing in Computer Generated Animation, " Computer 
Graphics, vol. 17, No. 3, pp. 377-388, 1983.* 
Pixel, Oct. 1993; p. 41, picture 4. 



ART-UNIT: 2671 



PRIMARY-EXAMINER: Zimmerman; Mark 
ASSISTANT-EXAMINER: Padmanabhan; Mano 
ATTY-AGENT-FIRM: Oliff & Berridge, PLC 



ABSTRACT: 



The present invention provides a three-dimensional simulator apparatus and image 
synthesis method which may realistically simulate the real world when the velocity 
and/or rotational velocity of a display object has changed or when the surface 
state of that display object is to change in accordance with simulation 
circumstances. An image synthesis section (200) contains a texture computation 
section (230) for performing computations to map textures onto the display objects 
and a texture information storage section (242) for storing information of the 
textures to be mapped. Different types of texture information is stored in the 
texture information storage section (242) for the same display object. Either the 
type of information of the texture to be mapped onto the display object or 
information specifying that type is changed in accordance to the velocity and/or 
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rotational velocity of the display object, or with the surface state of the display 
object which surface state changes with simulation circumstances. This enables an 
increase in realism of the simulation. 



20 Claims, 25 Drawing figures 
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L6: Entry 4 of 7 



File: USPT 



May 7, 2002 



DOCUMENT-IDENTIFIER: US 6384834 Bl 

TITLE: Three-dimensional simulator apparatus and image synthesis method using 
texture computation and texture information storage 

Brief Summary Text (4 ) : 

Various types of three-dimensional ( 3D) simulator apparatus that are used in 
applications such as 3D games and piloting simulators for aircraft or other 
vehicles are known in the art. With such a 3D simulator apparatus, image 
information relating to a 3D object 300 shown in FIG. 20A is previously stored 
within the apparatus. This 3D object 300 depicts an element such as scenery that 
can be seen by a player (observer) 302 as if through a screen 306. This display 
object is displayed as a pseudo-3D image (projected image) 308 on the screen 306, 
by perspective projection conversion on the screen 306 of the image information of 
the 3D object 300. When the player 302 specifies an operation such as rotation or 
forward motion through a control panel 304, this apparatus performs predetermined 
3D computation processing on the basis of the resultant operating signals. More 
specifically, computations are first performed to determine whether a change has 
occurred, such as a change in the viewpoint and where the eyes of the player 302 
are directed or a change in the position and orientation of a vehicle in which the 
player 302 is sitting, as specified by these operating signals. Computations are 
then performed to determine how the image of the 3D object 300 can be seen on the 
screen 306, in accordance with this change such as a change in viewpoint and where 
the player's eyes are directed. The above computations are performed in real time, 
following the actions of the player 302. This makes it possible for the player 302 
to see any change in the scenery, due to a change in the player's own viewpoint or 
where the player's eyes are directed or a change in the position or orientation of 
the vehicle in which the player is sitting, as a pseudo-3D image in real time, to 
simulate the experience of a virtual 3D space. 

Detailed Description Text (18) : 

In this embodiment, the image synthesis section 200 comprises a texture computation 
section 230 and a texture information storage section 242. In this case, the 
texture computation section 230 performs computations for mapping a texture onto a 
display object . The texture information storage section 242 stores texture 
information for the mapping done by the texture computation section 230. This 
texture information represents patterns such as the patterns of lettering and 
wheels to be mapped onto the side surface of a tire, or that of a tread surface to 
be mapped onto the running surface of the tire. A plurality of types of texture 
information are stored in the texture information storage section 242 for the same 
display object, such as a tire. More specifically, texture information representing 
lettering and a wheel (spoke) pattern for a halted state, texture information 
representing lettering and a wheel pattern that are slightly blurred by the 
rotation of the tire, and texture information representing lettering and a wheel 
pattern that are completely blurred so that they flow in the direction of rotation 
of the tire are stored as textures to be mapped onto the side surface of the tire. 
Similarly, texture information representing a totally black tread surface, texture 
information representing a tread surface that has gravel adhering to it and is 
speckled with white, and texture information representing an even whiter tread 
surface are stored as textures to be mapped onto the running surface of the tire. 
The 3D simulator apparatus of this embodiment also comprises means for modifying 
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the type of texture information, such as that to be mapped onto the side surface of 
the tire, in a manner consistent with a factor such as the rotational velocity of 
the tire or the running speed of the racing car. Similarly, the apparatus also 
comprises means for modifying the type of information of the texture to be mapped 
onto the running surface of the tire in a manner consistent with the surface-state 
of the tire that changes with the circumstances of the simulation (game 
circumstances) . In other words, if the circumstances of the simulation become such 
that the racing car leaves the course and enters a gravel road area and thus the 
state of the running surface of a tire that is a display object is to change to 
become speckled with white, for example, texture information representing a whitish 
surface is used for mapping onto the running surface of the tire. Note that these 
modification means may be formed within either a virtual 3D space computation 
section 100 or the image synthesis section 200, or within both. 

Other Reference Publication (2) : 

Korein et al . , "Temporal Anti-Aliasing in Computer Generated Animation, " Computer 
Graphics, vol. 17, No. 3, pp. 377-388, 1983.* 
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n 1. Document ID: US 20030088389 Al 
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L6: Entry 1 of 7 File: PGPB 

PGPUB-DOCUMENT-NUMBER: 20030088389 
PGPUB-FILING-TYPE: new 

DOCUMENT-IDENTIFIER: US 20030088389 Al 



May 8, 2003 



TITLE: Long elements method for simulation of deformable objects 
PUBLICATION-DATE: May 8, 2003 



INVENTOR-INFORMATION : 
NAME 

Balaniuk, Remis 

Costa, Ivan F. 

Salisbury, J, Kenneth JR. 



CITY • STATE COUNTRY 

Sunnyvale CA US 

Brasilia CA BR 

Mountain View US 



RULE-47 



US-CL-CURRENT : 703/2 



Date I Reference I Sequences I Attachmerrts I Claims 



n 2. Document ID: US 20020138607 Al 

L6: Entry 2 of 7 File: PGPB 

PGPUB-DOCUMENT-NUMBER: 20020138 607 
PGPUB-FILING-TYPE: new 

DOCUMENT-IDENTIFIER: US 20020138607 Al 



Sep 26, 2002 



TITLE: System, method and computer program product for data mining in a three- 
dimensional multi-user environment 

PUBLICATION-DATE: September 26, 2002 



INVENTOR- IN FORMAT I ON : 
NAME ' 

0' Rourke, Kristen P. 
Banks, Douglas S. 
McHugh, Jason G. 



CITY 

Menlo Park 
Menlo Park 
Menlo Park 



STATE 
CA 
CA 
CA 



COUNTRY 

US 

US 

US 



RULE-4 7 
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US-CL-CURRENT: 709/224; 709/218 



R^viei/^j 1 Classification | Date | Reference Sequences Attachments | Claims 



□ 3. Document ID: US 6765574 Bl 

L6: Entry 3 of 7 File: USPT 



Jul 20, 2004 



US-PAT-NO: 6765574 

DOCUMENT-IDENTIFIER: US 6765574 Bl 

** See image for Certificate of Correction ** 

TITLE: Methods of hierarchical static scene simplification and polygon budgeting 
for 3D models 



Class if ioatiori Date Reference 



□ 4. Document ID: US 6384834 Bl 

L6: Entry 4 of 7 File: USPT 



May 7, 2002 



US-PAT-NO: 6384834 

DOCUMENT-IDENTIFIER: US 6384834 Bl 

TITLE: Three-dimensional simulator apparatus and image synthesis method using 
texture computation and texture information storage 



Class if loation 



□ 5. Document ID: US 6307558 Bl 

L6: Entry 5 of 7 File: USPT 



Oct 23, 2001 



US-PAT-NO: 6307558 

DOCUMENT-IDENTIFIER: US 6307558 Bl 

** See image for Certificate of Correction ** 

TITLE: Method of hierarchical static scene simplification 



Full I Title: Citation Front Reviei/.j Classification Date Reference \\S^Amo^l \\ Attacl'tmeTftS | Clairr^sl KMC \ Drat^n D 



□ 6. Document ID: US 5867166 A 

L6: Entry 6 of 7 File: USPT Feb 2, 1999 

US-PAT-NO: 5867166 

DOCUMENT-IDENTIFIER: US 5867166 A 

** See image for Certificate of Correction ** 

TITLE: Method and system for generating images using Gsprites 
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reconstruction for e.g. graphics /animation 



Classification 




Terms 


Documents 


L5 not LI 


7 



Display Format : 



Previous Page Next Page Go to Doc# 



http://westbrs:9000/bin/gate.exe?f^TOC&state=h4gp90.15&ref^6&dbname=P 8/25/05 



Record Display Form 



Page 1 of 2 



First Hit Fwd Refs 



Previous Doc 

n 



Next Doc Go to Doc# 



Generate Collection 



Print 



1 



L6: Entry 3 of 7 



File: USPT 



Jul 20, 2004 



US-PAT-NO: 6765574 

DOCUMENT- IDENTIFIER: US 6765574 Bl 

** See image for Certificat:e of Correction ** 

TITLE: Methods of hierarchical static scene simplification and polygon budgeting 
for 3D models 



DATE-ISSUED: July 20, 2004 



INVENTOR-INFORMATION : 
NAME 

Mao; Xiaodong 
Guo; Baining 



CITY 

Foster City 
Bellevue 



STATE 

CA 

WA 



ZIP CODE 



COUNTRY 



ASSIGNEE-INFORMATION: 
NAME CITY 
Intel Corporation Santa Clara 



STATE ZIP CODE COUNTRY TYPE CODE 
CA 02 



APPL-NO: 09/ 979630 [PALM] 
DATE FILED: March 18, 2002 



PCT-DATA: 

APPL-NO DATE-FILED PUB-NO PUB-DATE 371-DATE 102(E) -DATE 

PCT/CN99/00218 December 23, 1999 WOOl/48697 Jul 5, 2001 

INT-CL: [07] G06 T 17/0£ 

US-CL-ISSUED: 345/428; 345/423 
US-CL-CURRENT: 345/428; 345/423 

FIELD-OF-SEARCH: 345/428, 345/423 
PRIOR-ART-DISCLOSED: 

U.S. PATENT DOCUMENTS 



Search Selected 



Search ALL 



Clear 



PAT-NO ISSUE-DATE PATENTEE-NAME US-CL 
n 5845277 December 1998 Pfeil et al . 

□ 6307558 October 2001 Mao 345/428 
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FOREIGN-PAT-NO 



PUBN-DATE 



COUNTRY 



US-CL 



WO 97/34253 



0 784 295 



0 549 944 



July 1993 
July 1997 
September 1997 



WO 



EP 



EP 



ART-UNIT: 2671 

PRIMARY-EXAMINER: Zimmerman; Mark 
ASSISTANT-EXAMINER: Arnold; Adam 
ATTY-AGENT-FIRM: Skabrat; Steven P. 

ABSTRACT : 

A method of scene simplification includes concurrently simplifying a plurality of 
objects in a scene represented by a hierarchical scene graph. The objects are 
represented as polygonal meshes and the hierachical scene graph includes a 
plurality of nodes, each node storing a mesh. The scene is a three dimensional 
scene and the objects are representations of three dimensional objects. 
Concurrently simplifying the plurality of objects includes determining an initial 
least level of detail polygon reduction ratio (LPPR) for at least one mesh, 
generating levels of detail variables for at least one mesh using the LPRR, and 
generating a simplified version of at least one mesh by using the levels of detail 
variables. The total number of polygons in a rendered scene may be set to 
correspond to a predetermined polygon budget. 

4 Claims, 10 Drawing figures 
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File: USPT 



Jul 20, 2004 



DOCUMENT-IDENTIFIER: US 6765574 Bl 

** See image for Certificate of Correction ** 

TITLE: Methods of hierarchical static scene simplification and polygon budgeting 
for 3D models 



Brief Summary Text (4): 

Computer-generated visual simulations are used in many application areas, such as 
flight simulation, building walkthroughs, computational fluid dynamics, and video 
games, for example, with the purposes of training, evaluation, education, and 
entertainment. Since recent general purpose graphics workstations and personal 
computers (PCs) allow the interactive display of thousands of polygons making up 
representations of three dimensional ( 3D) objects, these simulations have become 
more common and accessible to a variety of users, such as scientists, educators, 
and game players. However, as graphics performance increases and its cost 
decreases, a new generation of users will demand even more complex and more 
realistic animations . Such animations will require real-time performance at 
approximately constant frame rates so that the user has the feeling of actual 
immersion in a virtual world. 
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File: PGPB 



Sep 11, 2003 



DOCUMENT-IDENTIFIER: US 20030171190 Al 
TITLE: Games controllers 



Summary of Invention Paragraph : 

[0473] Measure/Process the inputs, in accordance with the software, "looking" for 
specific inputs, repeated inputs, combinations of inputs together or in sequences, 
etc and determines user's simulated position, velocities, accelerations, spins, 
forces, etc in accordance with all input signals and a virtual simulation engine 
and a 3D simulated world consisting of virtual roads, objects, events, worlds, 
etc., i.e. an environment of competitors, obstacles and opportunities for 
advancement/relegation in a gaming metaphor. The software uses 3D graphics, sound 
and trade secret movement sensor alogarithms and engines where not just the user's 
physical activity provides advantages but the user's technical skills with the 
steering/weight/lift/controls and brakes and seat also. 
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PGPUB- DOCUMENT -NUMBER : 20050171754 
PGPUB-FILING-TYPE: new 
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TITLE: Automatic scenery object generation 
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PGPUB-DOCUMENT-NUMBER.: 20050156928 
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